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(57) Abstract: It is possible to follow a moving object in an image and reduce the motion blur of the moving object. A motion vector 
^S, detection unit (30) detects a motion vector for the moving object in the image by using image data DVa on the image formed by a 
^ plurality of pixels acquired by the image sensor having a time integration effect. A motion blur reducing object image generation 

unit (40) uses the motion vector detected so as to reduce the motion blur generated in the moving object in the image and generate 
O image data DBf on the motion blur reducing object image. An output unit (50) synthesizes the image data DBf on the motion blur 
1^ reducing object image at the temporal/spatial position corresponding to the motion vector detected on the image accoiding to the 
^ background component image data DBb and generate image data DVout on the motion blur reducing image. 
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mmmmm^^M^4 4i\zmm-^n^. ^tc. mmnm^mm4 sfj^^m'^-^ 
nrz.mMm^mmy'-^r>Beu. sb3A^gi54 4 4\zm^-^n^o 
m^mmm^^MU4 4 iti. m^mmARiim^^^ hjvuv c\zm^^. 

m^x<Dm^:f5mzm^mmt^m^^m^^m^^ii\^xwL^^^. ^rz\t. 
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^a^^rpBMS¥^«fgHC§^T';Wb^4 4 2 <hSLj2.^gP4 4 4 Ic^fc^^f 

4 2n, m^^^7 hJVMvc^^zsm^-^nrcim^mm^&mm 

15 ^y'MtUA: 4 2«, ^#^Ufe^:7^;i/MD*::3^@5S:^^^4 4 3 iz^^ir^o 

■:^m^±m^4 4: 3tA. ^■7^;Ht:$l54 4 2-^^^^m-^nrc'Ey^)VMD^m\z:^m 

bT» »#«v;^it rsiiiSj xUM^mm:^ rsj tufc^^, PS^S-^-Ki^ 
©Hmftfi C 0 1 tccfe § tif F E 0 l-^iam^e C 02~ C 13 cfe S BiiS^K^> 
20 FE02~FE13«. ( 1 6 ) ~ (2 8) X^TZ. tfl^X^ 



FE01=F01/v 



(1 6) 



FE02=F02/v + F01/v 



(1 7) 



FE03=F03/v + F02/v + F01/v 



(1 8) 



FE04=F04/v + F03/v + F02/v + F01/v 



(1 9) 



25 



FE05=F05/v + F04/v + F03/v + F02/v + F01/v 
FE06=F06/v + F05/v + F04/v + F03/v + F02/v 
FE07=F07/v + F06/v + F05/v + F04/v + F03/v 
FE08=F08/v + F07/v + F06/v + F05/v + F04/v 
FE09=F09/v + F08/v + F07/v + F06/v + F05/v 



(2 0) 



(2 1) 



(2 2) 



(2 3) 



(2 4) 
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FE10=F09/v+F08/v + F07/v+F06/v ••• (2 5) 

FEll=F09/v+F08/v + F07/v -(2 6) 

FE12=F09/v + F08/v -(27) 

FE13=F09/v •- (2 8) 

•^m^±^^4 4 3f}^^mT^:^m^^. ^ (29) (41) iz^to 

FE01=1 • FOl/v+0 • F02/V+0 • F03/v+0 • F04/v+0 • F05/v 

+0 • F06/V+0 • F07/V+0 • F08/v+0 • F09/v - (2 9) 
FE02=1 • FOl/v+1 • F02/V+0 • F03/v+0 • F04/v+0 • F05/v 
10 +0 • F06/V+0 • F07/V+0 • F08/V+0 • F09/V -(30) 

FE03=1 • FOl/v+1 • F02/V+1 • F03/v+0 • F04/v+0 • F05/v 

+0 • F06/V+0 • F07/V+0 • F08/V+0 • F09/V - (3 1) 
FE04=1 • FOl/v+1 • F02/V + 1 • F03/v+l • F04/v+0 • F05/v 

+0 • F06/V+0 • F07/V+0 • F08/V+0 • F09/V - (3 2) 
15 FE05=1 • FOl/v+1 • F02/V+1 • F03/v+l • F04/v+l • F05/v 

+0 • F06/V+0 • F07/V+0 • F08/v+0 • F09/v - (3 3) 
FE06=0 • FOl/v + 1 • F02/V+1 • F03/v+l • F04/v+l • F05/v 

+1 • F06/V+0 • F07/V+0 • F08/v+0 • F09/v - (3 4) 
FE07=0 • FOl/v+0 • F02/V+1 • F03/v+l • F04/v+l • F05/v 
20 +1 • F06/V+1 • F07/V+0 • F08/V+0 • F09/V -(3 5) 

FE08=0 • FOl/v+0 • F02/V+0 • F03/v+l • F04/v+l • F05/v 

+1 • F06/V+1 • F07/V + 1 • F08/V+0 • F09/v - (3 6) 
FE09=0 • FOl/v+0 • F02/V+0 • F03/v+0 • F04/v+l • F05/v 

+1 • F06/V+1 • F07/V + 1 • F08/V+1 • F09/v - (3 7) 
25 FE10=0 • FOl/v + 1 • F02/v+0 • F03/v+0 • F04/v+0 • F05/v 

+ 1 • F06/V + 1 • F07/V + 1 • F08/V+1 • F09/V -(3 8) 
FE11=0 • FOl/v+0 • F02/V+0 • F03/v+0 • F04/v+0 • F05/v 

+0 • F06/V + 1 • F07/V+1 • F08/V+1 • F09/v - (3 9) 
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FE12=0- FOl/v+0- F02/V+0- F03/v+0 • F04/v+0- F05/v 

+0 • F06/V+0 • F07/V+1 • F08/v+l • F09/v — (4 0) 

FE13=0 • FOl/v+0 • F02/V+0 • F03/v+0 • F04/v+0 • F05/v 

+0 • F06/V+0 • F07/V+0 • F08/v+l • F09/v ••• (4 1) 

Z.<D^ (2 9) ~ (4 1) ^ (4 2) ^:bT^■r^l^:%-e#So 

09 

F E j= ^ a ij ■ F i/v —(42) 
i=01 

^^^#^t-^<h, ^ (4 2) ts. ^ (4 3) (D^o\zm.^:ihifiii 



^ (4 3) {C:feViT. em. C j {C^^n^^MT^ il©^ (4 

3) \t. ^ (4 4) f3»#m;l'5ili:3^>t-e^^. 



j=01 

mf}^o\zf3in\t^\^^:i2i'fy^B. ^ (4 6) ^mrdt^vizFk^^ib^o 



09 

FEj=^ajj • Fi/v + ej 
i=01 



(4 3) 



09 

e j= F Ej-2; alj • Fi/v 
i=01 



... (44) 




(4 5) 



d Fk 



d E 



13 

= 2 e j ■ O e j/d Fk) 

j=01 



13 09 
= 2-21 ({FEj-X aij • Fi/v) • (-akj/v))=0 
j=01 i=01 



- (46) 
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10 



15 



20 



25 



(4 6) l:i:feViT, l&#av«H^{i"e&-5*^e>. 5S; (4 7) ^m<^ti!fi 
13 09 

Xakj • (F Ej-Xa ij • F i/v) = 0 — (4 7) 

j=01 i=01 

^ (4 7) ^mrnvx^mt^t. ^ (4 8) ^#So 



13 09 13 

X^akj - Xaij - Fi)=v "Xakj ■ FEj 

j=01 i=01 j=01 



(4 8) 



;i©^(48) (DktC. 1^9(DmWCC0\,^'ttl-^^l'O'&i^XVXni^n^9-O 

(D^\zmm't^o $6.tc, #e)ti^9-Q©^s:> ff^jic<ko locD^icj^o^t- 
(4 9) izm-to 

05 

i=01 
06 

ZFEi 

i=02 
07 

ZFEi 

i=03 
08 

ZFEi 

i=04 
09 

ZFEi 

i=05 
10 

ZFEi 

1=06 
11 

ZFEi 

i=07 
12 

Zf Ei 

i=08 
13 

ZFEi 

i=09 
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0 
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F05 
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2 




F06 
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3 




F07 
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4 




F08 
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2 


3 
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F09 



(4 9) 
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Z.<D^ (4 9) • F = v • F-Ehmrrt. A. v «^:5^;Hk(3DBt 

J;iJ:D, pmiiiFEtC'^^nTl.i^ll^^r^m^i^^Ctj&^T^^o 

fP4 4 3 il© J;5 (C^^^^nfciE^:;^5g^*Sbj2i^5^-i^U4 4 4 lil-e^J^f^o 

jeb32i^gP4 4 4tt. PSMa¥te^^lf|5 4 4 1 >0ve)#t|&$nfc|iS5fLSm^ 
IffgHCSrSlC. Htfafife^lil#-7='-:$'DBe^> ^^^^figgP4 4 3 6,#fcjp&$ 
n;^tf2?!l<D^lCigfet" -So SLji,^^|[B4 4 4H. H^^— ^CDig^}^^ 

nfcfTa?ij3S;^?^^§P4 4 5 tc^j^rs. 

ti^t5*(Diiim{iiF01~F09Sfe^-r^o c:<D^^bfeliim{itF01'-F09t;i, M 

F01~F09(Diii#^a:K^^5gbT. ^aj^ti 1 :7 1^— AiiK© 1 2 oD-feffi-etB:^ 
§15 5 0 fi^fc-fe. 0 1 6 lc^-rj:-5lc^ P^{itF01~F09^lii^& 

-iS'D vafc^ 1 :7 ix—A^rB^o \/2<o^-{^ y^n^tin 5 0 ic:#^)S&-r-s. 
:7 i^-a^Fb1 J; t) *)MVi let*. m%mii(r> \/2 (Dfi:ffiT?m:^fB 5 o \z.m^ 

nfet&:i:^:^P#-7^-i$' D B f S-S-^ bTll^^^'— D Vout UTtB^'^-r ^ o 
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nrcmx$>^tvx=ey'Mti.x. M«:=r>^i^xi7 h^:5^<i:WS^:/>?xi^ 

10 #:^:/i^xi^ hO^K^^^^StUT. ^i-ilbfcl&^^tt/v'xi^ hOfi^^fcft^^^i 

mmmmmm.(Dm(Dm^iiiyxv y h^? x-yxwi^-^^mi^^nom-^^^i^x 

CPU (Central Processing Unit) 6 ROM (Read Only 
15 Memory) 6 2. *fcttl31tg|5 6 3 iClBlJi$nTVi^^D^^AJc:tJe'3T€-@(J!)^ 

U6 IdtUfx-r^^^n^-^A-^^acDT^—^^iait-r^o ram (Random 
Access Memory) 6 4lCl^. CPU 6 Iti^M^'t^yn^'^A-^^UOMM^ff 

^mzm\^^^n^y''-^^f)m^s&^-^n^o cms^cpuei, rom6 2. 
CPU6 1 iz\ts nx6 5^^vx. xt!^y^yj^—7.^6 6^mti^y^ 

25 5^^7;yi/-r. xb°--:^j7^£<^m;t?^fij&^'^gi^$nTVi^. CPU6 1«. A;b 

^>^ya^—x^6 6-fy^^xti-^n^m^\zMmhx^m(Dmm^mn'r^o 
UT, cpu6i«. mm(DUM^iDnftmm'p'^pm^mti^>:$'y:j:.-y.^ 

6 lib^^miJ-t^o aimgB6 8«, -O^-^^i-/ ]>> ^<D^®:^^-/ hy-i^^^n- 
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m%^^7.if. ^"f^cA^. ¥^^^;>^^U?5:^:^^^«r$n 

:k\z. mi s(Dyu-~^^'-h^mmhXs m^iiBtmmm<owjmz-o\,^xmm 

T.T-y'^^ST 2XCPVe 1«> :$1'^:d^e>®Je^&^ttT5!ia^^*^^-rSc 
;^-x^y:/ST 3-eCPU6 1 ^DVa^fflV^T, 7.7^-/:/ST2 

i^xi^ hOB f a)Wl##^^Sj^t-^fe8e>i&^3j^^SM:4-y>^Xi^ hH^^^m 

^wm\\^xmmmm.-^^WL-t'^. z.(D^^mm.(o^^x\'t. ^ma^-^-iiiifiyv 

-Atn-Tr^-gxh^. #n-l, #n, #n+l, #n+2(D®^5^— V^T 
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^^^M-^ita^ rij , ■m^m.mn,m^\ta^ roj ^:t■^o 

;^-7"^:/>^STl 3-eCPU6 Hir«#«^i{l®a^fTVi. 7^5^>;/ySTl 

'-'^nv^^'^>'^m.mz'o\,-^x\'t±M(D^ (12) > r>f3n—\^nv^ 
yYm.m\z'D\^xu±m(o^ ds) <D^m-^n\^^m^m.6^^ik^x. mmm.^ 

7.5^^y^sT 1 4-ecpu6 m^-^ym^9Sim^n\f^s x5^-/:/st5 

M»^:^^®#-7^— ^j^i-g-^n^ i&.±(Dmm^^'rm^^m^^^^^vx. 7. 
^y-fSTi sx^mvtcmM^^m^y'-^iz^^n^m^-^y^is.m-^'i^^o 
rf3it>t>. Wi^^^ h JVMY c tmmmmm^uz iimmm^ARiz^-zs^mm 

m\z. =Ey'Mt^mnvxsEm:^n^^if^^^o z.(DiiFmvrciEm:^m^\zm 

my'-^^m^l^X. m^mi^m (Gauss-Jordan^m*^) ;^<H(D^?*fc«^< 

mm^m\ m'^-^drmm:ty'i^:j^i^ hmm(Dmmy'—i$^. -tuiD-^m^^^ufi 
sx^mhrc^mm^mm^-:^\zm':^<mm±(D7.y^yysT sxn^nrzm 
(Dm^^^—^DVoMt^^mvxmts-r^o 
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7.^vzf ST 2\zm^. wi^-m^o:>mmmm^nt>f3i\^^t^\tmm^mT-r^o 
^±m.^hWj^mi^tm^m^m\zK^vx. m^mmtm-^mi^o^mmy^ 

^^-rmwm^m^HB^mtimzmm-r^. 

hmm^^m4 o ^(DmmmmmM^A sit. ifr^2j^ycD^M^ff5®#±05^^ 
SBf^ici^bT, z,(Df^BmmizMT^W}^^^ h jvcDWj'^z^mz^t^'&xmm 
mm^mmvxmM^4 9 izm^-r^o ^^c. a&@p*<Dte«^m::^ifP5 0 ate 

(2N+1) iiim^©i!!i3am^^ig^'r§p m2 2\tmmmm(Dm^m^^\^x 

)\^(o:^\^-^^m^i^m\iBx^'r^'D\z7K^:^^x^^m^\t. mz zaiz^t^ 
'o\z7^^^:^\^\zmmmHWA^mM^^o m^^i^ h)V(D^i^7f}mtb:&\^ 
x^i^m-^it.. m2 2B\z^v^^^\z. ^m'r:bn&-:^\^\zmmmmwA^m 
ST^o r^fdh. mi^-:^mzmmmi^^^Mir^miz\it, mmm^<Dmm^m\z 

CZ.X. mmmmp^xit. m2 s\z^-t^^\z. iiim:^is^{y_8, • • 
Yo, • • Ys)f}mmm'^-^nx\^^^o j^^is. 02 m^m^i)^ rv = 
5j x$>-oxmmmm^i smm (n=6 : N«^sHmic:*ff s^ataijiscDiiim 
m thrcm^x$>^. 
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So 

5 .... Xf.t't^h. ^ (5 0) \Z^-r^Z>ti: (2N+1) MOM^ 

t+h 

X (Yi/v) =Xt (5 0) 

i=t-h 

10 ( t =-N, • -,0. • -.N) 

b55^b. :^8t)fcVi^i&#^^ (Y_N_h. • • •. Yo. . • Y^+h) «^ 

(2N+V) m&^o -rtJitD-^. ^W(i(Dm^^'h^<DWcf}^{>tSi\,^CO'V. ^ (5 
0) (Y_N-h. • • Yo, • • Y^+h) ^^Js^SCl 

Yt-Yt + i=0 - (5 1) 

(t=-N-h, • • •, 0, • • N+h-1) 

'rf3it>t>. ^(5 0) T^^ns (2N+ 1) moym^^t^ (5 d 

20 (2N+V-1) M<D|feI^^<£'&t>ti:;t (4N + v) m<D^^m\^^X. (2 

N+v) fi<D*^^mT$.SII1tt#^^ (Y_N-h. • • Yo. • • • . Yn 

^ (5 2) 0 2 3 tC:^t-<fc'5lC^ilMi^^igSb;feJ»'&^^bT43D. ^ 
(5 0) (5 1) {C^n^n©^T^^T-5^^€:SP;l^c'b(Z)T^So 
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X -6 




®m-6 
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6 m -3 
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® m 1 
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Yo 
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X 4 
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X 6 
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*= bfi 
eb7 
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0 , 




©ba 

ebg 

ebio 
ebn 
ebi2 
eb,3 
eb,4 



(5 2) 



^(O^ (5 2) (5 3) tbT^-rc^;0^'T#. ^(5 4) iC^fH^O 

-^fqESr«/jNi:-rSJ:-57^Y (=Y,) (5 5) tbX^^-So ts.^. ^ 
(5 5) fCcfeV^T. T^^SMff^J'e^SClt^^bTV^So 

AY = X + e "(Sa) 



E = |e| =Xemi2 +2;e b 
Y= (A^ A)"^ A^ X 



(5 4) 



(5 5) 



{^a-bT. ^ (5 7) tc:^-rj;-5{::-(im5^«to <h75:^J;5^c:-rntf. m^<75: 
mit^MLf\^t.f^^'^ (5 5) ^^J&^Ciij&^'T^So 
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